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Abstract 

The  use  of  branch  and  bound  methods  to  solve 
certain  types  of  combinatorial  problems  is  discussed. 
The  approach  is  illustrated  on  the  traveling  salesman 
problem.   A  6  city  problem  is  worked  out  in  detail. 
Then  a  flow  diagram  is  given  for  a  general  discrete 
variable  minimization  problem.   Finally^  applications 
in  job  sequencing^  flow-shop  scheduling^  and  traffic 
light  synchronization  are  described. 


Branch  and  bound  methods  have  been  found  useful  for  solving  cer- 
tain rather  difficult  optimization  problems.   Two  notable  examples 
are  the  traveling  salesman  problem[l2]  and  the  three  machine  scheduling 
problem  [14, 9] .  The  branch  and  bound  idea  offers  a  general  framework 
for  the  optimization  rather  than  a  complete  specification.   Detailed 
procedures  must  be  worked  out  to  fit  each  problem  type  and  these  are 
an  important  determinant  of  the  computational  success  of  the  method. 
However,  the  successes  so  far  offer  encouragement  that  new  problems 
can  be  approached  the  same  way. 

We  shall  illustrate  the  process  on  the  traveling  salesman  problem. 
The  branch  and  bound  approach  will  then  be  discussed  in  general  and  a 
flow  diagram  given  for  it.   Finally  some  further  applications  will  be 
described. 

The  Traveling  Salesman  Problem 

The  traveling  salesman  problem  owes  its  fame  to  looking  easy  but 
being  hard.   The  problem  may  be  stated  as  follows:  A  salesman  starting 
in  one  city  wishes  to  visit  each  of  n-1  other  cities  and  return  to  the 
start.   In  what  order  should  he  visit  the  cities  to  minimize  the  dis- 
tance traveled?   For  "distance"  we  can  substitute  time,  cost,  or  other 
criterion  as  desired.   In  fact,  the  most  interesting  current  applications 
have  nothing  to  do  with  salesmen  but,  as  we  shall  see,  are  concerned 
with  scheduling  a  sequence  of  jobs  on  a  machine.   This  application  is 
of  considerable  interest  to  the  present  audience. 
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The  difficulty  of  the  problem  is  entirely  computational  since 
the  number  of  "tours"  (i.e.  feasible  solutions)  is  finite.   Enumeration 
of  all  tours^  however,  would  be  a  discouraging  process  for  a  problem 
of  any  appreciable  size.   There  are  (n-1) I  tours.   Doubling  the  size 
of  a  problem  from  5  to  10  cities  multiples  the  number  of  tours  by 
about  15  thousand;  doubling  from  10  to  20  cities,  by  about  250  billion. 

To  put  the  branch  and  bound  algorithm  in  perspective,  we  report 
briefly  on  other  approaches  to  the  traveling  salesman  problem.   Several 
methods  have  been  developed  for  finding  a  good  but  not  necessarily 
optimal  tour.   One  of  these  is  random  search.   Since  any  permutation 
of  the  first  n  integers  can  be  interpreted  as  a  tour,  it  is  an  easy 
matter  to  generate  a  tour  by  a  random  process,  evaluate  its  cost,  and 
compare  it  to  the  best  of  any  previously  developed  solutions.   Since 
these  steps  can  be  performed  quickly,  a  large  number  of  tours  can  be 
generated,  and  the  best  one  will  usually  be  a  good  solution.   Further- 
more, the  statistics  generated  make  it  possible  to  say  something  about 
the  probability  of  finding  a  better  solution.   This  type  of  approach 
has  been  investigated  by  Heller  [8]  for  a  somewhat  different  problem 
and  in  much  more  detail  with  more  sophisticated  random  search  procedures 
by  Reiter  [16, 17]  for  the  traveling  salesman  problem.   On  a  somewhat 
similar  tack  Karg  and  Thompson  [10]  have  developed  a  heuristic  program. 
However,  their  program  is  designed  primarily  for  the  symmetric  case. 
Such  approximate  methods  are  important,  especially  for  large  problems. 
However,  it  is  obviously  desirable  to  find  solutions  that  are  optimal 
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and  known  to  be  so,  whenever  this  can  be  achieved  with  a  reasonable 
amount  of  computation. 

Gilmore  and  Gomory  [4]  have  an  elegant,  efficient  algorithm  for 
a  case  of  traveling  salesman  problems  where  the  cost  matrix  is  of  a 
special  type.   In  addition,  some  specific  problems  [1]  have  been 
solved  by  tailor-made  arguments  developed  for  the  particular  numbers 
involved. 

Consider  then  methods  that  (1)  guarantee  optimality  (2)  seem 
reasonable  to  program  and,  (3)  are  general.   One  method  is  to  formulate 
the  problem  as  an  integer  program  [15,18].   However,  to  date  I  know  of 
no  published  computational  results.   Held  and  Karp  [7]   and  Gonzalez 
[5]   have  formulated  the  problem  by  dynamic  programming  and  have  coded 
it  for  the  computer.   The  largest  problem  solved  has  been  13  cities. 
Beyond  this,  time  and  storage  requirements  go  up  very  rapidly.   Finally, 
we  have  the  branch  and  bound  methods   developed  by  Murty,  Sweeney,  Karel, 
and  myself  [12]..  Problems  vary  in  difficulty  for  this  method.   Our 
prinicpal  class  of  test  problems  has  been  asymmetric  cost  matrices  con- 
structed from  3  digit  random  numbers.   We  have  solved  problems  up  to 
40  cities  in  size.   Symmetric  problems  taken  off  maps  are  harder  but 
a  25  city  problem  has  been  solved  without  difficulty.   For  details,  see 
[12]  .   We  have  solved  no  sequencing  problems  but  I  know  of  specific 
instances  in  which  others  have  solved  a  17  city  and  a  21  city  problem 
based  on  live  data.   Thus,  although  it  is  not  hard  to  construct  large 
problems  that  cannot  be  solved  in  a  reasonable  length  of  time  and  it 


would  probably  be  possible  to  construct  some  especially  difficult  small 
problems^  it  seems  fair  to  say  that  problems  up  to^  say^  20  cities^  appear 
to  be  in  quite  good  shape.   Furthermore^  as  we  shall  point  out^  the 
method  can  be  programmed  so  that^  if  the  algorithm  is  stopped  short  of 
completion,  a  feasible  solution  is  produced  that  is  usually  rather  good 
and  in  some  cases  is  optimal.   More  generally,  some  of  the  approaches 
used  here  might  be  useful  in  a  heuristic  program  for  the  problem. 

We  shall  simultaneously  present  the  algorithm  and  work  out  an 
example.   Verbal  arguments  will  be  given  at  each  step.   Detailed  proofs 
will  be  omitted. 

Consider  the  matrix  of  Figure  1.  The  entry  at  position  (i,j)  say 
c(i,j)  represents  the  cost  (distance)  for  going  from  city  i  to  city  j. 
A  tour  is  a  set  of  city  pairs,  e.g., 

t  =  [  (1,3)  (3,2)  (2,5)  (5,6)  (6,4)  (4,1)  ] 
which  spell  out  a  trip  that  goes  to  each  city  once  and  only  once.   Let 
z  be  the  cost  of  a  tour.   From  Figure  1  it  may  be  soon   that  the  above 
tour  would  cost: 

z  =  43  +  13  +  30  +  5  +  9  +  21  =  121. 
If  a  constant  is  subtracted  from  each  element  of  the  first  rov^7  of 
Figure  1,  that  constant  is  subtracted  from  the  cost  of  every  tour.   This 
is  because  every  tour  must  include  one  and  only  one  element  from  the 
first  row.   The  relative  costs  of  all  tours,  however,  are  unchanged  and 
so  the  tour  that  would  be  optimal  is  unchanged.   The  same  argument  can 
be  applied  to  the  columns. 
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Figure  1.   Cost  matrix  for  a  6-city  Problem 


1 

2 

3 

4 

5 

6 

oo 

11 

27 

® 
0 

14 

10 

1 

oo 

15 

0 

29 

24 

15 

13 

00 

35 

5 

© 
0 

(D 

0 

0 

9 

oo 

2 

2 

2 

41 

22 

43 

oo 

© 

0 

13 

0 

® 
0 

^ 

© 

0 

oo 

Figure  2.   Cost  matrix  after  row  and  column  reduction 
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The  process  of  subtracting  the  smallest  element  of  a  row  from  each 
element  of  a  row  will  be  called  reducing  the  row.   Thus  the  first  row 
in  Figure  1  can  be  reduced  by  16.   Note  that,  in  terms  of  the  unreduced 
matrix,  every  trip  out  of  city  1  (and  therefore  every  tour)  will  have 
a  cost  of  at  least  16.   Thus,  the  amount  of  the  reduction  constitutes 
a  lower  bound  on  the  length  of  all  tours  in  the  original  matrix. 

Step  1:   Reduce  the  rows  and  columns  of  the  cost  matrix.   Save  the 
sum  of  the  reductions  as  a  lower  bound  on  the  cost  of  a  tour. 

The  results  of  reducing  Figure  1  are  shown  in  Figure  2.   The  total 
reduction  is  48  and  so  z  >  48  for  all  tours. 

Next  we  split  the  set  of  all  tours  into  two  disjoint  subsets.   This 
is  conveniently  indicated  by  drawing  a  tree  as  in  Figure  3.   The  node 
(branching  point)  containing  "all  tours"  is  self-explanatory.   The  node 
containing  1,4  represents  all  tours  which  include  the  city  pair  (1,4). 
The  node  containing  1,4  represents  all  tours  which  do  not.   From  the 
1,4  node  we  might  later  want  to  branch  again,  say,  on  the  basis  of 
(2,1).   In  Figure  3  the  node  containing  2,1  represents  all  tours  which 
include  both  (1,4)  and  (2,1).   In  general,  by  tracing  back  from  a  node 
to  the  start  we  can  pick  up  which  city  pairs  are  specified  to  be  in  and 
which  out  of  the  tours  represented  by  the  node.   If  the  branching  pro- 
cess is  carried  far  enough,  some  node  will  eventually  represent  a  single 
tour.   Notice  that  at  any  stage  of  the  process,  the  union  of  the  sets 
represented  by  the  terminal  nodes  is  the  set  of  all  tours. 


Figure  3.   Start  of  tree 
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Figure  4.   Matrix  after  deletion  of  row  1  and  column  4 
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Returning  to  the  question  of  lower  bounds^  we  have  seen  that  48  is 
a  lower  bound  on  all  tours.   In  Figure  2  the  starting  node  is  accordingly 
marked  with  48.   Consider  the  first  row  of  Figure  2.   Suppose  that  city 
pair  (1,4)  is  not  in  a  tour.   Then  since  city  1  must  be  assigned  to  some 
city,  the  tour  must  incur  a  cost  of  at  least  10  (the  second  smallest  ele- 
ment in  row  1) .   This  is  on  top  of  the  48  already  reduced  out  of  the  ma- 
trix.  Similarly,  since  some  city  must  be  assigned  to  city  4,  the  tour 
must  further  incur  the  cost  of  the  second  smallest  element  in  column  4. 
The  element  happens  to  be  zero  in  this  case  and  so  the  total  lower 
bound  is  still  58.   The  node  has  been  so  marked  in  Figure  3. 

Thinking  ahead,  suppose  we  eventually  discover  a  tour  with  z  =  56. 
Then,  in  a  search  for  the  optimal  tour,  it  would  be  unnecessary  to 
examine  any  of  the  tours  in  the  node  1,4  since  they  all  have  z  >  58. 
Not  knowing  in  advance  what  z's  will  be  found,  we  shall  select  the 
element  on  which  to  branch  so  as  to  increase  most  this  lower  bound. 
Let  0(k,£)    be  the  jump  in  lower  bound  if  (k,^)is  chosen  for  branching. 
As  indicated  in  the  example: 

0(k,^)   =   smallest  element  in  row  k,  omitting  the  (k,^)  element 

+  smallest  element  in  column,  omitting  the  (k,^)  element 
Thus  we  have: 

Step  2:   Given  a  node,  X,  from  which  to  branch  next,  and  given  the 
cost  matrix  associated  with  X,  find  the  city  pair  (k,j>,)  which  maximizes 


9.      Extend  the  tree  from  X  to  a  node  k,i.   Add  6{k,ji)    to  the  lower  bound 
of  X  to  set  the  lower  bound  of  the  new  node. 
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Inspection  of  the  matrix  will  show  that  0ik,Z)    =   0  unless  c(k,^)  =  0 
so  that  the  search  for  max  6   is  confined  to  the  zeros  of  the  matrix. 
In  Figure  2  the  6   values  are  shown  in  small  circles.   The  largest  occurs 
for  (1,4)^  as  already  chosen  to  illustrate  branching. 

Next  we  put  in  a  step  needed  later  to  detect  when  the  end  of  a  tour 
is  near. 

Step  3:   If  the  number  of  city  pairs  committed  to  the  tours  of  X 
is  n-2,  go  to  Step  6.   Otherwise  continue. 

Returning  to  the  example,  we  seek  a  lower  bound  for  the  1,4  node. 
Since  all  tours  here  contain  (1,4),  row  1  and  column  4  are  no  longer 
needed  and  may  be  crossed  out.   Next  observe  that  no  tour  in  the  set 
represented  by  this  node  can  contain  the  city  pair  (4,1).   This  is 
because  (1,4)  (4,1)  constitute  a  two  city  subtour,  and  it  is  impossible 
for  a  tour  to  contain  a  subtour.   Therefore,  without  loss  of  tours,  set 
c(4,l)  =  oO  .   This  will  prevent  (4,1)  from  being  chosen  as  part  of  a 
possible  tour.   After  the  changes  in  the  matrix,  further  reduction  of 
rows  or  columns  may  be  possible.   In  the  case  at  hand,  row  2  can  be 
reduced  by  one.   See  Figure  4.   Adding  this  to  the  previous  lower  bound 
gives  49,  which  has  been  marked  on  the  node  in  Figure  5.   Summarizing: 

Step  4:   Finish  the  branching  based  on  (k,^)  by  extending  the  tree 
from  X  to  a  node  k.i:  m.p.   Here  (m,p)  is  the  city  pair  which  would  join 
the  ends  of  the  longest  connected  path  involving  (k,^)  in  the  set  of 
committed  city  pairs  of  the  new  node.   Delete  row  k  and  column  Z    in  the 
cost  matrix  and  set  c(m,p)  =aO  .      Reduce  rows  and  columns  if  possible  and 
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add  the  amount  of  the  reduction  to  the  lower  bound  of  X  to  set  the  lower 
bound  for  the  new  node. 

A  further  example  of  finding  (m^p)  is  illustrated  by  the  node  2^1. 
All  tours  at  this  node  contain  (2^1)  and  (1^4).   The  addition  of  (4^2) 
would  create  a  3  city  subtour^  which  we  shall  prevent  by  specifying 
c(4^2)  =  oo  for  the  node.   One  could  also  set  c(l,2)  =  oo  but  row  1  has 
already  been  crossed  out  and  so  there  is  no  advantage.   The  only  worth- 
while candidate  for  (m^p)  is  always  the  element  that  completes  the 
longest  subtour  involving  (k^^). 

We  now  repeat  the  basic  branching  procedure  of  Steps  2  and  4;  ex- 
tending the  tree^  and  working  up  the  lower  bounds  as  we  go.   Thus: 

Step  5:   If  no  node  has  been  found  which  contains  only  a  single  tour, 
find  the  terminal  node  with  the  smallest  lower  bound  and  return  to  Step 
2  for  branching.   Otherwise  continue. 

A  comment  is  required  about  branching  to  the  right  versus  branching 
to  the  left.   Branching  on  the  k,£   node  (to  the  right  in  Figure  5)  is 
the  usual  operation.   It  involves  crossing  out  rows  and  columns  and  other 
manipulations  which  are  conveniently  done  on  the  same  physical  represen- 
tation of  the  matrix,  whether  stored  on  paper  or  in  a  computer.   When 
one  returns   to  extend  a  k, i  node  (moving  to  the  left)  it  is  usually  ad- 
vantageous to  reconstruct  an  appropriate  matrix  from  the  original  cost 
matrix,  rather  than  arranging  to  save  cost  matrices  for  each  node  as  it 
is  laid  out.   We,  therefore,  give: 
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Step  2a:   If  a  cost  matrix  is  needed  for  node  X,  start  \>;ith  the 
original  cost  matrix  and 

(1)  Find  the  city  pairs  committed  to  be  in  the  tours  of  X 
and  add  their  cost  elements  together  to  form  part  of  the  lower  bound 
for  X. 

(2)  For  every  (i,j)  which  is  one  of  these  city  pairs,  cross 
out  the  i   row  and  j    column  of  the  matrix.   Add  infinities  at  pro- 
hibited city  pairs. 

(3)  Reduce  the  remaining  matrix  and  add  the  amount  of  the 
reductions  to  that  found  in  (1)  to  give  a  lower  bound  for  X. 

(4)  Perform  the  instructions  given  in  Step  2. 

The  lower  bound  and  the  reduced  matrix  are  not  necessarily  unique^ 
consequently^  when  a  new  bound  is  calculated^  the  old  is  discarded. 
However,  bounds  calculated  in  the  two  ways  will  usually  be  the  same. 

As  Steps  1-5  are  performed  on  the  example,  the  tree  of  Figure  5 
is  developed,  up  to  the  final  node:  4,3;  6,2. 

Here,  Step  3  causes  a  jump  out  of  the  loop.   Step  2  will  have  told 
us  that  the  current  branching  is  based  on  (4,3).   This,  plus  the  city 
pairs  found  by  tracing  back  the  tree,  shov;  that  n-1  city  pairs  are  al- 
ready committed  to  the  upcoming  node.   But  the  n-1  determine  what  the 
last  must  be  (here  (6,2)),  and  we  have  found  a  single  tour  node.   Exam- 
ination of  the  final  2X2  cost  matrix  will  show  that  no  reduction  is 
possible  and  that  the  cost  of  the  remaining  pairs  relative  to  this  matrix 
is  zero.   Thus  the  tour  has  z  =  63. 
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Furthermore,  since  every  possible  tour  is  contained  in  one  or  an- 
other of  the  terminal  nodes  and  each  of  the  other  nodes  has  a  lower 
bound  greater  than  63,  we  have  found  the  optimal  tour. 

Step  6:   If  entry  to  this  step  is  from  Step  3,  the  next  node  is 
k,i;    m,p  where  (m,p)  is  the  only  city  pair  left  after  crossing  out  row 
k  and  column  Z.      The  node  contains  a  single  tour.   Calculate  its  cost. 
For  any  entry  to  the  step,  let  t„  denote  the  tour  with  the  smallest 
cost,  say  z^,  among  single  tours  found  so  far.   If  z   is  less  than  or 
equal  to  the  lower  bound  of  every  terminal  node  on  the  tree,  t^.  is 
optimal.   Otherwise  choose  the  multiple  tour  terminal  node  with  the 
smallest  lower  bound  and  return  to  Step  2  for  branching. 

At  this  point,  let  us  stand  back  and  review  the  general  motivation 
of  the  algorithm.   It  proceeds  by  branching,  crossing  out  a  row  and 
column,  blocking  a  subtour,  reducing  the  cost  matrix  to  set  a  lower 
bound  and  then  repeating.   Although  it  is  fairly  clear  that  the  optimal 
solution  will  eventually  be  found,  why  should  these  particular  steps  be 
expected  to  be  efficient?   First  of  all,  the  reduction  procedure  is  an 
efficient  way  of  building  up  lower  bounds  and  also  of  evoking  likely 
city  pairs  to  put  into  the  tour.   Branching  is  done  so  as  to  maximize 
the  lower  bound  on  the  k,^  node  without  worrying  about  the  k,£   node. 
The  reasoning  here  is  that  the  k,^  node  represents  a  smaller  problem, 
one  with  the  k   row  and  Z        column  crossed  out.   By  putting  the  emphasis 
on  a  large  lower  bound  for  the  larger  problem,  we  rule  out  non-optimal 
tours  faster. 
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Figure  5.   Final  Tree 


optimal  tour 
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Insight  into  the  operation  of  the  algorithm  is  gained  by  observing 
that  the  crossing  out  of  a  row  and  column  and  the  blocking  of  the 
corresponding  subtour  creates  a  new  traveling  salesman  problem  having 
one  fewer  city.   Using  the  notation  of  Step  4,  we  can  think  of  city  m 
and  city  £  as  coalesced  into  a  single  city,  say,  m' ,   Setting  c(m,p)  =  oo 
is  the  same  as  setting  c(m',m')  =00.   The  blocking  of  subtours  is  a 
way  of  introducing  the  tour  restrictions  into  what  is  essentially  an 
assignment  problem  and  is  accomplished  rather  successfully  by  the  al- 
gorithm. 

Finally,  unlike  most  mathematical  programming  algorithms,  the  one 
here  has  an  extensive  memory.   It  is  not  required  that  a  trial  solution 
at  any  stage  be  converted  into  a  new  and  better  trial  solution  at  the 
next  stage.  A  trial  branch  can  be  dropped  for  a  moment  while  another 
branch  is  investigated.   For  this  reason  there  is  considerable  room  for 
experiment  in  how  the  next  branch  is  chosen.   On  the  other  hand  the 
same  property  leads  to  the  ultimate  demise  of  the  computation  -  for  n 
sufficiently  large  there  are  just  too  many  branches  to  investigate  and 
a  small  increase  in  n  is  likely  to  lead  to  a  large  number  of  new  nodes 
that  require  investigation, 

A  number  of  modifications  of  the  basic  method  can  be  proposed.   For 
one  thing,  it  is  computationally  advantageous  to  branch  to  the  right  un- 
til this  becomes  obviously  unwise.   Thus  our  program  always  branches  on 
the  k, Z     node  unless  its  lower  bound  exceeds  or  equals  the  cost  of  a  known 

tour.   As  a  result  a  few  extra  nodes  may  be  examined,  but  usually  there 
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will  be  a  substantial  reduction  in  the  number  of  setups  of  Step  2a.   An 
important  consequence  of  this  modification  is  that  the  calculation  goes 
directly  to  a  tour  at  the  beginning,  and  if  convergence  is  slow,  usually 
examines  many  complete  tours.   Then,  if  the  calculations  are  stopped 
before  optimality  is  proven,  a  good  tour  is  available.   Several  other 
embellishments  of  the  algorithm  are  discussed  in  [12], 

2.   A  General  Flow  Diagram 

Although  the  traveling  salesman  illustration  shows  an  application 
of  the  branch  and  bound  method  in  detail,  it  will  perhaps  be  helpful 
to  abstract  the  main  idea.   The  method  breaks  up  the  set  of  all  feasible 
solutions  into  smaller  and  smaller  subsets  and  calculates  for  each  a 
lower  bound  on  the  objective  function  of  the  best  solution  therein.   The 
bounds  guide  the  partitioning  of  the  subsets  and  eventually  identify  an 
optimal  solution:   When  a  subset  is  found  that  contains  a  single  solu- 
tion whose  objective  function  is  less  than  or  equal  to  the  lower  bounds 
for  all  other  subsets,  that  solution  is  optimal.   The  subsets  of  solutions 
are  conveniently  represented  as  the  nodes  on  the  tree  and  the  process 
of  partitioning  as  a  branching  of  the  tree;  hence  the  name  given  to  the 
method. 

The  convergence  of  the  process  can  be  assured,  at  least  in  the  case 
where  the  number  of  solutions  requiring  consideration  is  finite,  by 
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devising  a  partitioning  procedure  that^  at  worst^  leads  to  enumeration. 
As  we  have  noted,  however,  the  computational  efficiency  of  the  process 
is  very  dependent  on  the  methods  used  to  perform  the  partitions  and 
calculate  the  bounds.   The  successful  applications  so  far  have  exploited 
special  features  of  the  particular  class  of  problems  at  hand. 

The  branch  and  bound  idea  is  a  fairly  natural  one  and  predates  [12], 
although  the  particular  name  was  introduced  there.   Eastman  [2]  uses 
the  method  on  the  traveling  salesman  problem  but  applies  different 
branching  and  bounding  techniques  from  those  above.   Land  and  Doig  [11] 
propose  the  idea  for  mixed-integer  linear  programs. 

Consider  a  general  discrete-variable  problem  in  bounded  variables: 


min  z(x  , . . . , x  ) 


g.(x  , . . .,x  )  =  0       i  =  1, . . .,m 
1   i      n 


X.   e  A.  j  =  1,  .  .  ,,n 

where  A.  is  a  finite  set  of  possible  values  for  x..   Let 
J  -J 

X  =  (x  ,...,x  )   =   a  possible  solution 
1      n 

X  =  a  node  =  a  set  of  solutions 


* 

Some  writers  refer  to  the  methods  reported  here  as  forms  of  enum- 
eration.  This  is  to  distinguish  them  from  other  types  of  algorithm.   I 
think  the  term  may  be  misleading.   A  dictionary  definition  of  to  enumerate 
is  "to  name  one  by  one;  specify,  as  in  a  list."  [19].   In  solving  our  40 
city  problems,  we  averaged  about  5  completely  specified  tours  per  problem. 
A  40  city  problem  has  approximately  10'^"  tours.   By  the  same  definition 
the  simplex  method  seems  racher  enumerative,  since  it  proceeds  from  extreme 
point  solution  to  extreme  point  solution  with  convergence  guaranteed  by 
the  finite  (but  usually  huge)  number  of  such  solutions. 
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T,  II    =     nodes  constructed  by  branching  at  X- 

ur(S)   =  a  lower  bound  on  the  objective  function 
for  solutions  of  X^  i.e.^  z(x)  >  ur(2D 
for  X  e  X. 


value  of  the  objective  function  for  the 
best  solution  found  so  far. 


The  branching  scheme  we  shall  present  is  dichotomous^  with  X 
branching  into  Y  and  X  as  shown  in  Figure  6.   In  some  cases,  however, 
a  more  natural  procedure  will  be  to  create  more  than  two  nodes  at  a 
tine.   The  extension  is  straightforward. 


\ 


urCD 


Figure  6. 
Dichotomous  Branching 
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Figure  7  shows  a  flow  diagram  for  a  general  branch  and  bound 
algorithm.   In  a  specific  application  three  key  ad  hoc  steps  must  be 
added: 

(1)  How  to  compute  lower  bounds. 

(2)  How  to  select  x.  and  assign  x.. 

(3)  How  to  use  the  constraints  to  eliminate  infeasible 
solutions. 

In  the  case  of  the  traveling  salesman  problem,  bounds  were  computed  by 

reduction,  x.  =  x   was  selected  by  the  e(k,Z)    calculation,  and  the  tour 
'   J     J 

constraint  was  used  to  eliminate  certain  infeasible  solutions  through 
setting  c(m,p)  =  iiO  . 

Further  Applications 

Hatfield  and  Pierce  [6]   have  worked  on  the  sequencing  problem. 
Suppose  that  n  jobs  are  to  be  done  on  a  machine.   Let  c.   be  the  cost 
of  changing  over  from  job  i  to  job  j.   In  what  order  should  the  jobs 
be  done  to  minimize  the  sum  of  the  change  over  costs?   If  the  n  jobs 
form  a  cycle  to  be  done  repeatedly,  as  might  be  the  case  for  models  on 
a  production  line^  then  we  have  exactly  a  traveling  salesman  problem. 
Otherwise  we  can  create  a  dummy  job  which  costs  nothing  to  switch  to  or 
from  and  without  loss  of  generality  treat  the  sequence  as  a  cycle.   Then 
we  again  have  a  traveling  salesman  problem.   However,  Hatfield  and 
Pierce  add  an  important  practical  complication,  namely,  due  dates  for 
the  jobs.   These  appear  as  constraints  that  limit  the  number  of  feasible 
solutions.   Hatifeld  and  Pierce  also  find  it  helpful  to  introduce  more 
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X  «?~    Set   of    all 

solutions 
o^ 

Z     ^     00 


Find  lower  bound  uriZ) 


Select  an  uncommitted 
variable  of  the  x  of 
"X,  say,  x^,  and  assign 


it  a  va 


lu^, 


say. 


Create  a  branch  to  a  new 
node  r.  Y  =fxeX|x.  =  x° ? 

Find  lower  bound  Ur(Y)  . 


Create  a  branch  to  a  new 
node  f.  Z  =[xeX|x.,^  x°] 

Find  lower  bound  ur(Z) 


Any  uncommitted  variables 
in  X  e  T? 


yes 


Search  tree  for  multi- 
solution  terminal  node 
with  the  smallest  valufe 
of  lower  bound.  Let 
this  node  be  new  S. 


no 


z  <  ur(X) '' 

r 


yes 


Finish 
Solution  is  x 


no 


no 


Y  contains  only 
one  solution:  x 

z(x°)  <  z°? 


no 


yes 


z  4-  z(x  ) 


save  X 


Figure  7.   Flov;  Diagram  for  Discrete  Variable  Problem 
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complicated  selection  procedures  than  used  above. 

Lomnicki  [14]  and  Ignall  and  Schrage  [9]  have  applied  branch  and 
bound  methods  to  certain  flow-shop  problems.   They  have  achieved  marked 
success  relative  to  previous  methods.   The  problem  is  to  determine  a 
schedule  for  processing  n  jobs  on  m  machines.   The  machines  are  ordered 
and  a  job  cannot  start  processing  on  one  machine  until  it  has  been  pro- 
cessed on  the  previous  machine.   Several  objective  functions  are  possible, 
for  example,  the  time  at  which  all  jobs  are  finally  complete  (known  as 
the  makespan)  or  the  mean  completion  time.   Lomnicki  focusses  on  the 
3  machine  case  with  the  objective  of  minimizing  makespan.   In  this  case 
it  is  known  that  the  optimal  ordering  of  doing  the  jobs  is  the  same  on 
each  machine.   He  uses  as  test  problems  several  6  job  problems  devised 
by  Giglio  and  Wagner  [3]   for  their  numerical  investigations  of  various 
computational  approaches  to  the  problem.   Their  approach  for  finding  a 
guaranteed  optimum  was  integer  programming  and  proved  quite  disappointing. 
Some  examples  were  not  solved  after  10,000  iterations  on  an  IBM  7090. 
Lomnicki  solved  all  the  problems  by  hand. 

Ignall  and  Schrage  solved  the  same  test  problems  very  easily  by 
computer  with  a  branch  and  bound  algorithm  that  is  essentially  the  same 
as  Lomnicki' s.   They  solve  some  other  3  machine  test  problems  as  well. 
They  further  devise  and  demonstrate  an  algorithm  for  minimizing  the  mean 
completion  time  in  the  two  machine  case. 
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Branch  and  bound  methods  have  proven  helpful  in  work  done  by  my- 
self on  synchronizing  traffic  lights  [13].   The  problem  of  setting 
traffic  lights  on  an  arterial  street  can^  under  certain  circumstances, 
be  formulated  as  a  mixed  integer  linear  program.   Problems  involving 
networks  of  streets  can  be  similarly  formulated.   An  algorithm  has 
been  devised  to  take  advantage  of  the  problem  structure.   Each  light 
has  associated  with  it  a  set  of  equations  and  variables,  including  one 
integer  variable.   The  integer  variable  takes  on  either  the  value  0  or 
1.   Branching  is  done  on  the  basis  of  this  variable.   Bounding  is  done 
by  solving  an  r-light  subproblem,  the  integer  variables  for  the  r 
lights  having  been  specified  by  previous  branching.   The  subproblem 
is  an  ordinary  linear  program  so  that  the  mixed  integer  problem  is 
reduced  to  a  sequence  of  ordinary  linear  problems. 

4,   Conclusions 

We  have  illustrated  the  branch  and  bound  idea  and  reviewed  some 
of  its  applications.   It  is  a  technique  that,  if  coupled  with  inge- 
nuity in  the  devising  of  bounds  and  rules  for  branch  selection  can 
often  produce  useful  algorithms  for  rather  difficult  combinatorial 
problems . 
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